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IRFPA ROIC WITH DUAL TDM RESET INTEGRATORS AND SUB- 
FRAME AVERAGING FUNCTIONS PER UNIT CELL 

TECHNICAL FIELD: 

These teachings relate generally to semiconductor-based detectors of 
electromagnetic radiation and, more specifically, to readout integrated circuits 
(ROICs) used with infrared radiation (IR) focal plane arrays (IRFPAs), in 
particular those responsive to two or more spectral bands ("colors"). 

BACKGROUND: 

IR imaging systems that are responsive to two or more spectral bands presently 
require separate and additional detectors, electronics, spectral filters, and other 
optical components for each spectral band. The resulting size, weight, power, 
and complexity hinders the development and/or production of compact and/or 
affordable multi-spectral (color) IR imaging systems. Such systems are typically 
required for use in numerous critical applications, such as missile interceptors, 
missile launch detection/warning, IR search and track, automatic target 
recognition, and all-climate situational awareness. However, many of these 
applications require very close registration/alignment between the spectral bands 
within the composite multi-spectral image (both spatial and temporal), and 
conventional techniques are typically not well suited for serving such critical and 
demanding applications. 

It is known to attempt to solve these problems with multi-spectral staring (as 
opposed to scanned) IRFPAs having several design forms. These design forms 
have in common an array of pixels, typically photodiodes, that detect radiation in 
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two distinct spectral bands. The resulting signals from each band are then read 
out separately. These designs differ in details, but are generally divided into two 
categories, each having particular limitations in meeting the system requirements 
outlined above. 

So-called "sequential" designs detect/integrate and read out TR radiation in one 
band during one frame time (e.g., 16.67 milliseconds), and then detect/integrate 
and read out the other band during the next frame time. As such, the temporal 
mis-registration (or delay) between the detection of the two spectral bands is 
equal to the frame time of the sensor system. 

More specifically, previous IRFPA designs have operated the detector in the 
sequential mode by sv^tching the detector bias on alternate (sequential) frame 
periods. At least one type of conventional sequential two color ROIC unit cell 
contains a single capacitor, connected to the detector through a pair of 
direct-injection (DI) field effect transistors (FETs), such as MOSFETs. As the 
detector and DI MOSFET biases are switched on alternating frames the 
sequential ROIC/IRFPA system integrates and reads out one spectral band per 
frame. This results in the above-mentioned temporal mis-registration or delay 
between the two bands that is equal to the frame time, typically 16.67 ms. This 
conventional technique may be analogized to the use of a conventional rotating 
filter-wheel approach. 

In contrast, so-called "simultaneous" designs operate so as to detect/integrate in 
both spectral bands simultaneously, but they require two separate contacts 
between the two IR detectors and their corresponding ROIC components for each 
pixel (i.e., in each ROIC unit cell). In this case the required pixel size and/or cost 
is increased over that of the sequential two color IRFPA approach, and over that 
of the conventional single color IRFPA for that matter. The second detector 
contact per pixel, which requires additional unit cell area, typically prevents an 
optimum spatial registration (or co-location) between the two sensed spectral 
bands. 
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Reference can be had to the following U.S. Patents for teaching various aspects 
of multi-spectral IR detectors: U.S. Patent No.: 5,113,076, May 12, 1992, "Two 
Terminal Multi-Band Infrared Radiation Detector", by Eric F. Schulte; U.S. 
Patent No.: 5,373,182, December 13, 1994, "Integrated IR and Visible Detector", 
by Paul R. Norton; and U.S. Patent No.: 5,731,621, March 24, 1998, "Three Band 
and Four Band Multispectral Structures having Two Simultaneous Signal 
Outputs", by Kenneth Kosai, the disclosures of which are incorporated by 
reference herein in their entireties. 

SUMMARY 

The foregoing and other problems are overcome by methods and apparatus in 
accordance with embodiments of these teachings. 

These teachings beneficially combine the simplicity of the sequential 
detect/integrate and read out structure and method with the improved temporal 
registration of the simultaneous detect/integrate and read out approach by rapidly 
switching a sequential two color detector between spectral bands, while 
providing independent signal routes, one for each detected wavelength band, 
through the ROIC. The presently preferred unit cell architecture includes (for a 
two color embodiment) one capacitor that is time-shared so as to integrate the 
detected signal from one of the two spectral bands at a time, and one additional 
capacitor per band to store signal charge integrated on the integration capacitor, 
as well as to provide a means to add or average multiple integrated signals for 
each band. Switches (e.g., MOSFETs) in the unit cell operate so as to quickly 
alternate integration back and forth between the two spectral bands/detectors 
during each frame time, followed by a readout of the signals from both bands, 
thereby closely approximating true simultaneity. This approach, referred to 
herein as Time Division Multiplexing or TDM, due to its reduced complexity 
over conventional simultaneous approaches, significantly improves the 
producibility of small pixel detectors, since it requires only one electrical contact 
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and one corresponding interconnect (typically an Indium bump) per pixel unit 
cell. 



The ROIC in accordance with these teachings preferably includes and features a 
single contact between the detector and the ROIC in each unit cell, combined 
with a temporal registration between spectral bands of less than a frame time 
(e.g., less than about 16 milliseconds, and preferably less than about one 
millisecond). The ROIC in accordance with these teachings also includes and 
features a rapid switching of the detector bias and other circuit elements to 
achieve the TDM integration of signals from multiple detectors within each unit 
cell. The ROIC in accordance with these teachings may also include and feature 
at least one reset switch on the detector contact node, thereby promoting rapid 
and accurate detector bias switching between spectral bands during the time 
between TDM integration periods, also referred to as sub-frames. The ROIC in 
accordance with these teachings may additionally include and feature integrate 
enable switches between the detector contact and each integration capacitor in 
each unit cell, thereby providing low noise and low crosstalk between the signals 
originating from the different spectral bands. The use of sub-frame averaging 
(SFA) may also enhance the quality of the read out signal, and a pair of SFA 
capacitances may be provided for storing and accumulating detected charge 
during the frame time. 

During use, the improved ROIC is electrically coupled with two color 
photodiodes (IR detectors), and integrates charge from each detector spectral 
band onto a single shared integration capacitor in each unit cell. This is 
accomplished by TDM of the two bands within each integration period (which 
occurs during some fraction of each frame time). To accomplish this TDM 
function, the ROIC operates to switch detector and input circuit biases some 
number of times per integration period. Switching may occur in less than 10 
microseconds, and the IRFPA may switch between wavelength bands every 100 
microseconds. This achieves an integration efficiency of greater than 90% with a 
band-to-band temporal registration of about 100 microseconds, which is about 
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two orders of magnitude less than conventional sequential multi-spectral band 
approaches. The effects of spatial mis-registration on system performance are 
also addressed and minimized, as the simplified construction of the unit cell 
enables the unit cell to be placed within a small integrated circuit area (e.g., a 20 
micron square unit cell circuit area.) 

A method is disclosed for operating a unit cell of a readout integrated circuit, as 
is a unit cell architecture that operates in accordance with the method. The 
method includes steps that operate, during a first portion of a fi*ame period, for 
integrating a first signal detected in a first spectral band, and during a second 
portion of the fi-ame period, for integrating a first signal detected in a second 
spectral band. At the end of the fi-ame period, the method reads out the integrated 
signals for each spectral band. The step of integrating the first signal detected in 
the first spectral band may fiirther include storing the integrated first signal, the 
step of integrating the first signal detected in the second spectral band may 
fiirther include storing the integrated first signal; and the method then also, 
during a third portion of the fi-ame period, integrates a second signal detected in 
the first spectral band and combines the integrated second signal with the stored 
and integrated first signal. The step of reading out then out reads out the 
combined integrated signals and the stored and integrated first signal in the 
second spectral band. 

These teachings fiarther provide a unit cell of a readout integrated circuit that is 
coupled during use to a multi-spectral radiation detector (e.g., a two-color 
photodiode, or a plurality of discrete detectors responsive to different spectral 
bands). The unit cell includes circuitry operable during a first portion of a fi*ame 
period (a sub-fi-ame period) for integrating and storing a first signal detected in a 
first spectral band, the circuitry being operable during a second portion of the 
fi-ame period for integrating and storing a first signal detected in a second 
spectral band, and the circuitry being operable during a third portion of the frame 
period for integrating and storing a second or additional signal detected in the 
first spectral band, and so forth. The circuitry thereby combines, such as by 




01 W028AVCS/200 1-00290 6 

adding or averaging, the signals stored during the multiple sub-frames of each 
spectral band within each frame period. Responsive to an end of the frame 
period, the circuitry reads out the stored signals for each spectral band. 

In accordance with the TDM operation that is a feature of these teachings, also 
provided is a method for operating the unit cell of the readout integrated circuit 
so as to temporally align an image obtained in the first spectral band with an 
image obtained in the second spectral band. 

A feature of these teachings is a radiation detection assembly having a plurality 
of multi-spectral radiation detectors and a plurality of readout circuit unit cells. 
Individual ones of the readout circuit unit cells are electrically coupled to one of 
the multi-spectral radiation detectors through a node. Each readout circuit unit 
cell includes circuitry for reading out from the multi-spectral radiation detector, 
in a time division multiplex (TDM) manner, electrical signals generated by 
incident multi-spectral radiation. 

A further feature of these teachings is a method for operating a radiation 
detection assembly. The method includes providing a plurality of multi-spectral 
radiation detectors and a plurality of readout circuit unit cells, where individual 
ones of the readout circuit unit cells are electrically coupled to one of the multi- 
spectral radiation detectors through a node; and reading out from the multi- 
spectral radiation detector, in the TDM manner, electrical signals generated by 
incident multi-spectral radiation. 

In an illustrated, but not limiting, embodiment the first spectral band corresponds 
to long wavelength infrared radiation (LWIR), and the second spectral band 
corresponds to medium wavelength infrared radiation (MWIR). 
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BRIEF DESCRIPTION OF THE DRAWINGS: 



The above set forth and other features of these teachings are made more apparent 
in the ensuing Detailed Description of the Preferred Embodiments when read in 
conjunction with the attached Drawings, wherein: 

Fig. 1 is a schematic diagram of an embodiment of a ROIC unit cell circuit 
constructed in accordance with these teachings, and a waveform diagram 
depicting exemplary waveforms at three circuit nodes; 

Fig. 2 is a simplified schematic diagram of a ROIC unit cell circuit, in connection 
with a one color detector, and is useful when discussing Sub-Frame Averaging 
(SFA); and 

Fig. 3 shows a portion of the multi-spectral unit cell for an embodiment that 
includes a separate integration capacitance for each spectral band. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Reference is made to Fig. 1 for showing an embodiment of a ROIC unit cell 
circuit 10 constructed in accordance with these teachings. The unit cell circuit 
10 is amenable to fabrication in a CMOS process employing, by example, 0.5 
micron or 0.35 micron design rules. The unit cell circuit 10 is coupled during use 
to a detector array 12, constructed as an array of back-to-back photodiodes Dl 
and D2. In the illustrated example D2 is responsive to Long Wavelength IR 
(LWIR, e.g., 9.5 - 10.0 micron cutoff) and Dl is responsive to Medium 
Wavelength IR (MWIR), that is, to IR in the range of about 3 microns to about 8 
microns. However, in other embodiments photodiode pairs that are responsive to 
other spectral regions could be employed, such as photodiodes responsive to 
Short Wavelength IR (SWIR) and MWIR, or SWIR and LWIR, or to SWIR (or 
MWIR or LWIR) and Very Long Wavelength ER (VLWIR). The unit cell circuit 
10 is preferably coupled to the photodiode pair of the detector array 12 at a single 
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coupling point, referred to herein as a detector node (DN). This coupling may be 
made via an electrically conductive contact in combination with a conventional 
Indium bump, or by using an electrically conductive via. The single coupUng 
point represented by DN is an aspect of these teachings, as it enables the unit cell 
area to be reduced as compared to conventional designs that require an electrical 
contact for each photodiode. In practice, the detector array 12 and the ROIC are 
typically hybridized and bonded together both electrically and mechanically, and 
are positioned during use at a focal plane (FP) of an IR imaging system. The 
combination of the detector array 12 and the ROIC containing the readout unit 
cell circuits 10 may be referred to as a radiation detector assembly 1. The IR 
radiation sensing embodiment of the radiation detector assembly 1 is typically 
operated at cryogenic temperatures. 

The illustrated embodiment of the unit cell 10 includes two detector reset 
switches SI and S2 that are used to quickly re-bias the detector node DN when 
switching between spectral bands. Also coupled to the detector node DN are two 
direct injection FETs (DIl and DI2) that are connected in parallel between DN 
and a plate of an integration capacitance Cint. A pair of integrator (capacitor) 
reset FETs (RSTl and RST2) are also provided, one for the LWIR band and one 
for the MWIR band. In addition to resetting Cint, RSTl and RST2 can be used to 
minimize blooming, and may also be used to detect and suppress certain 
countermeasures. The accumulated charge on Cint at the end of an integration 
period is shared through one of two FET switches (SFl, SF2) onto one of a 
MWIR or a LWIR sub-frame averaging (SFA) integration capacitance 
Cavg_MW and Cavg_LW, respectively. The SFA capacitances can also function 
as additional integration capacitances, if the SFA function is not desired for a 
particular application.. The node containing Cavg_MW is provided to a ROIC 
MW column output signal conductor, and the node containing Cavg_LW is 
provided to a separate ROIC LW column output signal conductor, whereby the 
LWIR and MWIR integrated (and possibly averaged) charge is readout from 
rows of the unit cell circuit 10 to two separate and independent ROIC column 
signal paths, and is made available for further signal processing, such as 
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digitizing, conditioning and image processing, at an output of the ROIC. 
Alternatively, the LWIR and MWIR charges may be read out through a single 
output signal path, one after the other. 

The use of the SFA capacitances Cavg_MW and Cavg_LW is preferred for at 
least some applications as they allow numerous short sub-frames (i.e., those 
having a duration of less than the total integration time) to be averaged, and to 
thus effectively yield a larger electron bucket size, e.g., greater than 20 million 
electrons (in a 20 micron square unit cell area). Even larger effective bucket 
capacity can be achieved through the use of smaller IC CMOS design rules. 

By utilizing the Sub-Frame Averaging (SFA) technique a number of short 
sub-frame integrations can be averaged to effectively yield a larger bucket size 
by allowing a longer total integration time than could be achieved in a single 
integration period using the total available capacitance per band. Each 
sub-integration is shared onto a respective one of the storage capacitors 
CavgJVLW and Cavg LW. Each successive sharing increases the stored signal 
such that it approaches that on the integration capacitor Cint at one 
sub-integration, while at the same time reducing the noise with each averaging. 
The SFA technique is especially useful for the LWIR detector D2, where there 
are higher leakage and photo-currents, along with requirements for high 
sensitivity. The MWIR flux levels and leakage are generally sufficiently small 
that standard (non-SFA) integration onto the parallel combined capacitance (Cint 
+ Cavg) per band (e.g., 16.5 million electron bucket) does not fill it up. Hence, 
the SFA is preferably not required for use for the MWIR spectral band. However, 
SFA can be enabled for MWIR as well to provide a larger effective bucket 
capacity, should the MWIR operating conditions change (e.g., increased flux or 
integration times.) 

Referring briefly to Fig. 2, note also that SFA has a Noise Improvement Factor 
(NIF), given by NIF=sqrt((l+a)/(l-a)), where a=Cavg/(Cint+Cavg). As an 
example, if Cavg is 600 fF and Cint is 200 fF, then the NIF becomes 2.65. If 
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Cavg and Cint are equal, then the NIF becomes 1.7. This NIF is one beneficial 
characteristic of the larger effect bucket capacity that is an aspect of these 
teachings. 

The unit cell circuit 10 may be operated in a wide range of system operating 
conditions, for example, conventional 30 Hz, 60 Hz and 120 Hz fi-ame rates with 
very low to very high flux levels and detector leakage currents. If fast fi*ame rate 
operation is desired (e.g., the available integration time is limited) in a low flux 
environment, then a Multi-Frame Averaging (MFA) operation may be desired to 
compensate for the reduction in incident JR flux during one (shorter) frame time 
by extending the total integration time over multiple frame times. Conversely, 
SFA is desired for operation at slower frame rates and/or higher fluxes (i.e., the 
available integration capacitance is limited.) 

In the unit cell circuit 10 of Fig. 1 simultaneous two color temporal alignment is 
achieved by integrating the LWIR band for, by example, approximately 1 
millisecond both before and afl:er a longer 2-5 millisecond integration period of 
the MWIR band. Thus, the LWIR band TDM yields a nominal two millisecond 
total integration period that is divided in time on both sides of the 2-5 mS MWIR 
integration time. While this provides the desired temporal registration of the 
LWIR image to the MWIR image, other timings may be employed as well. In the 
nominal case, the total LWIR acquisition is comprised of a plurality (e.g., 10) 
short sub-integrations of approximately 0. 1 milliseconds each. Five such LWIR 
sub-integrations are performed on each side of (i.e., both before and afl;er) the 
longer MWIR integration period, as is generally shown in the waveform diagram 
of Fig. 1. 

Discussing the schematic diagram of Fig. 1 now in fiarther detail, a purpose of the 
detector node (DN) reset switches SI and S2 is to quickly re-bias the detector 
node DN afl:er a change in photodetectors has been selected (i.e., a change from 
LWIR detector Dl to MWIR detector D2, and vice versa). The reset function 
implemented by SI and S2 provides a low impedance path to discharge the 
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capacitance of the selected detector, and also quickly establishes the desired bias 
point for the next band (e.g. within approximately one microsecond). The use of 
both SI and S2 is preferred, as it allows two static bias levels (vRstDetLW and 
vRstDetMW) to be established and switched in when desired, under the control 
of switching signals pDetRstLW and pDetRstMW, respectively. The levels of the 
static bias levels vRstDetLW and vRstDetMW may be fixed, or they may be 
made programmable. In other embodiments only a single DN bias reset switch 
may be employed, and the single switch may be provided with a programmable 
source of bias voltages for use with the LWIR and the MWIR cases. In a further 
embodiment no DN bias switch may be employed. 

In addition to reset switches SI and S2, which quickly rebias the detector node 
DN after a change in photodetectors has been selected, the detector common bias 
(Vdetcom) may also be switched between two different values. This can be done, 
for example, to increase the dynamic range. 

The direct injection (DI) FETs DIl and DI2 are operated in or near their 
sub-threshold regions, with their sources (S) connected to the detector node (DN) 
and their gates (G) coupled to switched biases (for band-switching control). Their 
respective drains (D) are coupled in common to the node that includes Cint. The 
DI FET for the LWIR case (DI2) is preferably a MOS device, and thus sources 
current out of Cint into the detector node DN. The MWIR DI FET DIl is 
preferably an NMOS device, and thus sinks current from the detector node DN 
into Cint. 

Turning now to the integration capacitor reset and bloom control/sense FETs 
RSTl and RST2, these FETs work in tandem with one another during the frame 
time. For the MWIR case, one FET resets Cint and holds it in reset until the 
beginning of integration is desired, while the other provides a bloom control 
spill- way or path for electrons, i.e., bucket levels that exceed some user-defined 
threshold (e.g., those arising from sun glints, flares, countermeasures, etc.). The 
LWIR case employs a juxtaposition of function, i.e., what was the bloom 
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control/sense FET now becomes the Cint reset FET and vice-versa. This 
operation is preferred, as during the MWIR integration period the integration 
direction on Cint is up, while for the LWIR integration period the integration 
direction on Cint is down (recall that during MWIR integration current is sourced 
into Cint, and during LWIR integration current is sourced out of Cint). The FET 
swapping is thus employed to reset and sense these respective different voltage 
potentials. The reset potential level for RSTl is vRstUCMW, and the control 
signal is pRstMWUC, while the reset potential level for RST2 is vRstUCLW, 
and the control signal is pRstLWUC. 

Threat and artifact sensing may be performed with the bloom control/sense FETs. 
As flux levels exceed a user defined threshold that is set by the ofF-voltage level 
of the pResetUC clocks, charge is spilled onto the row bus vRstUCMW of 
vRstUCLW. This row bus may contain an amplifier to sense this charge and 
possibly either prevent clocking, i.e. sub-frame averaging, of the latest 
sub-integration, and/or may notify a host system as the data is read out that a 
threshold has been exceeded. 

A suitable value for Cint is 200 fF. Cint may be physically constructed fi-om two 
parallel connected 100 fF polyl-poly2 capacitors. In order to minimize the 
required integrated circuit layout area these two capacitors may be stacked over 
the averaging capacitors Cavg_MW and Cavg_LW, and their polyl plates 
shared. Assuming, by example, a 3.3 volt range when using a 0.35 micron 
CMOS process, sub-frame averaging with this Cint achieves an effective bucket 
capacity in excess of 40 million electrons. This large effective bucket capacity is 
achieved with 10 sub-integrations, each of which is shared onto a 600fF storage 
capacitor that is used to implement Cavg_LW. 

The SFA switches SFl and SF2 isolate the averaging capacitors Cavg_MW and 
Cavg_LW, respectively, from Cint during the sub-integration periods, and 
alternately allow sharing of charge when required. Cavg_LW and Cavg_MW 
function as storage capacitors to achieve simultaneous TDM SFA operation. 
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With the sharing of each sub-integration, the averaging capacitors Cavg_LW and 
Cavg_MW build up signal slowly, and thus also serve to reduce detector shot 
noise. This is very advantageous for LWIR operation, which is generally 
susceptible to higher noise levels and greater leakage currents. 

While not shown in Fig. 1, a conventional column capacitive transimpedance 
amplifier (CTIA) may be used to read both unit cell storage capacitors Cavg LW 
and Cavg_MW, through row-enable switch FETs, into an output multiplexer. 
There may be one CTIA per LW and MW column output, or one CTIA may be 
multiplexed between the two column outputs. 

It is preferred that the area of the unit cell circuit 10 be made small so as to 
minimize the size of the associated system optics, while maximizing the 
resolution of the multi-spectral images. The disclosed embodiment is suitable for 
fabrication within a 20 micron square unit cell area using both 0.35 micron and 
0.5 micron rules, and thus provides a very desirable size. 

The TDM ROIC discussed above may be modified in various ways, as may occur 
to those skilled in the art when guided by the foregoing description. For example, 
and as was mentioned, a single DN reset FET may be employed (or none), as 
opposed to the two shown in Fig. 1. Also, and referring to Fig. 3, it is within the 
scope of these teachings to provide two integration capacitances Cintl and Cint2, 
one for each spectral band. In this case the SFA capacitances may or may not be 
required. 

It is also noted that the switch pS UN and the capacitor Csh, which are shown in 
Fig. 2, may be incorporated into the embodiments of Figs. 1 and 3 as well, as 
their presence may promote improved noise performance with respect to SFA. 

Also, it should be appreciated that the foregoing teachings may be extended to 
sensing incident IR in more than two spectral bands, as well as to sensing 
electromagnetic radiation in bands other than the ER band, such as visible 
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electromagnetic radiation. It should also be appreciated that the detected spectral 
bands need not be disjoint, and that some amount of overlap may occur between 
the spectral bands. 

Thus, while these teachings have been particularly shown and described with 
respect to preferred embodiments thereof, it will be understood by those skilled 
in the art that changes in form and details may be made therein without departing 
from the scope and spirit of these teachings. 




